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Abstract 

In this paper, we generalize a positive recurrence criterion for multidimensional 
discrete-time Markov chains over countable state spaces due to Rosberg (JAP, 
Vol. 17, No. 3, 1980). We revisit the stability analysis of well known slotted- Aloha 
protocol with finite number of queues. Under standard modeling assumptions, we 
derive a sufficient condition for the stability by applying our positive recurrence 
criterion. Our sufficiency condition for stability is linear in arrival rates and does 
not require knowledge of the stationary joint statistics of queue lengths. We be- 
lieve that the technique reported here could be useful in analyzing other stability 
problems in countable space Markovian settings. Toward the end, we derive some 
sufficient conditions for instability of the protocol. 

1 Introduction 

Recently there has been much activity in trying to understand the stability region of 
different multipleaccess schemes for wireless networks of which the Aloha protocol and 
its variation Slotted-Aloha protocol are archetypes. The most common access scheme 
for wireless networks is the contention mechanism used in the IEEE 802.11 that uses a 
exponential window type of backoff where the window doubles if collisions occur. Due to 
the difficulty of analyzing the stability region much attention has been focussed on the 
so called saturation throughput. This is the average throughput seen by each queue or 
user assuming that they always have a packet to transmit. Thus the entire question of 
stability is sidestepped. It is well known and by now there are many text-book accounts 
of it [T] that the slotted aloha scheme is unstable when the number of users (or queues) 
goes to infinity and there is a fixed probability of attempting to transmit. It is only the 
finite case that is really unknown. 



* Preliminary version of the results reported here are to appear in the Proceedings of 21st International 
Teletraffic Congress (ITC 21), Paris. 



The stability analysis of slotted Aloha protocol with finite number of queues has at- 
tracted lot of attention from researchers since its formulation by Tsybakov and Mikhailov [2] 
in 1979. The continued interest in this protocol is chiefiy due to the fact that in spite 
of its extreme simplicity the analytical difficulties presented by the interacting queues 
has yielded no general necessary and sufficient conditions for positive recurrence. The 
standard modeling assumptions made in the literature to analyze this protocol result 
in a discrete-time Markov chain model of the queue lengths over a countable set. An 
important performance measure of this protocol is stability, i.e., for what set of arrival 
rates at different queues the average delay experienced by a packet is finite. In this paper, 
we resurrect a positive recurrence criterion for countable space multidimensional Markov 
chain proved by Rosberg [3] that has been largely forgotten. We show usefulness of this 
criterion by first generalizing criterion [3] due to Rosberg and then applying it to the 
stability analysis of buffered slotted- Aloha protocol with finite number of queues. 

The discrete-time countable space Markov chain modeling of the slotted-Aloha pro- 
tocol with finite number of queues was first proposed and analyzed by Tsybakov and 
Mikhailov in [2]. In P], they provided the exact stability characterization when the 
number of queues J = 2. The next effort was by Rao and Ephremides ^ in 1988 who 
provided exact stability conditions for J = 2, and sufficient conditions for stability for 
J > 2 using stochastic dominance arguments and assuming Bernoulli input process at 
each queue. In 1994, Szpankowski [5J obtained the exact stability region for J > 2. The 
stability region characterization is given in terms of the stationary probabilities of joint 
statistics of the queues. However, for systems with more than three queues, the neces- 
sary and sufficient condition cannot be computed explicitly since it becomes very hard to 
compute the joint stationary statistics of the queues. In 1999, Luo and Ephremides [6] 
introduced the concept of "stability rank" to obtain tight inner and outer bounds to the 
stability region when J > 2. When queue i is known to be stable, then any queue j 
such that < ^i('^-Pi) jg g^jgQ pxQYQji to be stable, where A,- and are, respectively, 

Pj Pi J J 

the average packet arrival rate and the fixed transmission attempt probability of the jth 
queue. Then it immediately follows that if queue k is unstable then ^''^^'P''^ > Mlz£i)_ 
With the help of stability ranks, they computed tight inner bounds to the stability region. 
Unfortunately, here also it is required to determine some stationary joint probabilities 
but which are extremely difficult to compute. 

In all these papers, the goal was to derive sufficiency conditions for a fixed transmission 
attempt probability vector p. Instead, if one considers the union of the stability regions 
over all possible transmission probability vectors p, one obtains the closure of the stability 
region. In 1991, Anantharam [7j obtained closure of the stability region for J > 2 albeit 
for a correlated arrival processes. 

Recently, in [8], a simple approximate expression for the stability region was proposed 
by using mean field analysis. Indeed they show a propagation of chaos takes place when 
the number of interacting queues is large. This expression is proved to be exact when the 
number of queues grows large, and is also shown to be accurate in the case of small-queue 
systems through numerical experiments. The approximate stability region is derived 
assuming that queue lengths evolve independently. The boundary of the approximate 
stability region is characterized by a parametric expression that is a function of the 
attempt probability vector p. Our sufficient conditions for stability are in the form of 
simple linear inequalities and hence lead to much easier verification. 

Our approach leads to sufficient conditions that do not depend on knowing the sta- 
tionary distributions, and are completely characterized by the arrival parameters and 
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the attempt probabilities of the queues. In particular, we show that for the case of two 
and three interacting queues we can recover the known results. However, we have found 
a few instances where certain arrival rate vectors A satisfy the sufficiency condition for 
stabihty derived by Luo and Epphremides |6] but not ours. However we do not need to 
establish the stability of any higher rank queue as they require. 

A popular technique to establish ergodicity of countable space Markov chains is 
through Foster-Lyapunov approach which consists of finding a function that satisfies 
Foster's criterion [9]. Though this approach proved to be very successful for one dimen- 
sional Markov chains, but finding such a function proved to be very difficult in the case 
of multidimensional Markov chains. Rosberg [3] extended Foster's criterion [9] for J- 
dimensional Markov chains by requiring existence of J functions, one for each coordinate 
of the process. But the applicability of his criterion became limited by the difficulties 
that arise in verifying his conditions. The main contribution of this paper is in proposing 
a generalization of the positive recurrence criterion due to Rosberg [3J, thus expanding 
the scope of its applicability, and also distilling some of the assumptions made therein 
into a form that immediately lead to easier verification. To illustrate the applicability of 
our criterion, we derive sufficient conditions for stability of the well known slotted- Aloha 
protocol for multiaccess communication. 

The rest of the paper is organized into two major parts: Section [2] and Section [3j In 
Section [2| we generalize the positive recurrence criterion for multidimensional countable 
space Markov chains due to Rosberg [3] . In Section |3| we apply the positive recurrence 
criterion developed in Section [2] to the stability analysis of the slotted- Aloha protocol 
with finite number of queues. We provide some remarks on the instability of the protocol 
in Section 3.4 We end the paper with conclusions in Section 111 



2 A Generalized Foster-Lyapunov Type Criterion for 
Positive Recurrence 

Let A" be a countable set of states over which the irreducible, aperiodic, and discrete-time 
Markov chain {X", n > 0} takes its values. For any integer k > 1, define {p^y, x,y G A"} 
to be the k-step transition probability law of the Markov chain {X"',n > 0}. For any 
subset B O X, we know that the lim/j^ooP^e = hnifc^oo J^yesPxy = '^i^) — exists and 
is independent of the initial state x. For any nonnegative-valued function V on X, let us 
define A^V{x) — '^yPxy^iv) " V{x) to be the fc-step drift of the function V in state x. 
Let us now define the notion of "partial order" on the state space X. Let ^ be a binary 
relation on the set X such that 



(i) X ^ X for all X E X (refiexivity) 

(ii) X ^ y and y ^ z imply x ^ z (transitivity) 

(iii) X ^ y and y ^ x imply x = y (antisymmetry) 

Then ^ is called a partial order on the set X. An element x* & X is called the 
minimal element of X with respect to the partial order :< if x* ^ y for all y E X. Let us 
now suppose that ^ defines a partial order on the set X, and the Markov chain evolution 
over the discrete-time n is modeled by the stochastic mapping / defined as 
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_ /(X",A"), n>0 



(1) 



where X" G A" and A" is the input (driving function) to the system. We will see two 
instances of this stochastic recursive relation in equations ^ and ([T]) in the context of 
slotted-Aloha protocol. Let us say that the mapping / is order-preserving when, for a 
fixed input A", we have 



We now state our main contribution, which is a generalization of the multidimensional 
positive recurrence criterion due to Rosberg [3], as the following theorem. In the rest 
of the paper, we will be using the same notation X to denote both the state space and 
its subsets. The distinction is made through the usage of subscripts, i.e., Xj denotes a 
subset. 

Theorem 2.1 Let J > 2 be an integer. 

Assumption 2.1 There exists a collection V = {Vi,V2, ■ ■ ■ iVj} of partitions of the set 
X where Vj = \^Xj,Xj^, and nonnegative-valued functions {Vj{x),x G X} for I < j < J 
such that the drift AVj{x) of the function Vj in the state x has the following form: 

where tj > and r]j > 0. 

Assumption 2.2 There exist partitions {-^j./c-^jfc}; k >1 and I < j < J, of the set 
X with the following two properties: 

(i) ply = 0, < I < k - 1, for X G Aj f, and y G Xj 

(a) rijAj^k is a finite set 

Assumption 2.3 The stochastic recursive relation f (equation ^Jthat models the sys- 
tem is order-preserving , and for 1 < j < J the drift function AVj{x) in the argument x 
is a non-increasing function with respect to the partial order :<, i.e., x ^ y ^ AVj{x) > 
AV.iy). 

Then the Markov chain {Xn,n > 1} is positive recurrent. u 



Before we formally prove Theorem 2.1 and then point out how Theorem 2.1 generalizes 
the positive recurrence criterion of Rosberg, we briefly discuss a multivariate stochastic 
order known as usual multivariate stochastic order [IQl and also establish few supporting 
Lemmas. 
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2.1 Multivariate Stochastic Order for Random Variables 

Let ^ be a partial order on the set X. For any two elements x and y in X, we say that 
a set i3 C A* is (i) an Upper Set ii y E B whenever x ^ y and x E B and (ii) a Lower Set 
ii y E B whenever y ^ x and x E B. For any two random variables X and Y that take 
values in the set X, we say that the random variable X is stochastically larger than the 
random variable Y if 



p{XeB) > p(YeB), V Upper sets i3 C A' 

When X is stochastically larger than Y, we write X >g^ Y. We say that X is 
stochastically smaller than Y, i.e., X <g^ Y, if 



p{X eB) > p{Y eB), V Lower sets BCX 

An important characterization of the usual stochastic order is given in the following 
theorem due to Strassen [Ilj . 

Theorem 2.2 (Theorem 6.B.I. in jlOj ) The random vectors X andY satisfy X <gf 
Y if, and only if, there exists two random vectors X and Y , defined on the same probability 
space, such that X =gf X , Y =gf Y , and P |x < y| = 1. h 



In Lemma 2.1, we state an expression for A''V{x) in terms of the one-step drifts 



{AV{x),xe X}. 

Lemma 2.1 Let ti and t2 be positive integers. Then 



Proof: 



yex 



yex \zex J 

z&X y(^X 

J2pi\{^''Viz) + Viz))-Vix) 

z&X 

A'wix) + J2p%^''Viy) 

yex 
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Corollary 2.1 Define to = 0. For some integer J > 1, let ti,t2, ■ ■ ■ ,tj be positive 
integers. Then for x (z X , 



j-i 



yex j=0 



Proof: Repeated application of Lemma [2T gives the result. ■ 
Next, we establish that limfc^oo l'^^V{x) = c* > under the assumption that the 
Markov chain is irreducible and aperiodic. To see this, assume that the drift AV{x) 
is upper bounded by a positive constant rj. Then it is easy to see the existence of 
limfc^oo lA^V{x) because lim^^oo |A^V^(x) = lim^^oo I T^y^x ^^iv) Eto^PLy < V- More- 
over, since and V{x) > 0, we have 



itoiA'i/w=itoi(^rf„v-fe)-v-w] 



c* >0 



Lemma 2.2 For any non-negative random variables Yi, Y2, . . . , Ym and a constant a > 0, 



Proof: 



( \ 1 



< >a) 

i=l 
W 1^ 

< -E^y^^ 

i=l 

where (6) follows from Markov inequality. 

Lemma 2.3 Let k>l. Then A^^x) < -kej, I < j < J , for x e Al^. 
Proof: LetxeAU. Then A^Vj{x) 



k-l 

n 

xy 



yeX 1=0 

k—1 k—1 

yeXj 1=0 yeXf 1=0 



(a) 

< —ken 



where (a) follows from Assumption 2.2 
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Let us assume that AVj{x) assumes Lj different values dj^i > dj2 > ■ ■ ■ > dj^i. on the 
set X. For 1 < k < Lj, define Aj^k = {x & X : AVj{x) = dj^k}- It is obvious to note that 
the collection of sets {Aj^k, 1 < ^ < Lj} defines a partition of the set X. We now deduce 
that, for 1 < Z < Lj, the set IJfci« ^j,k is an Upper Set. This simple fact follows from the 



Assumption 2.3 of Theorem 2.1| that AVj{x) is a non-increasing function with respect to 
the partial order ^. Alternately, the set IJi=i ^j,k is a Lower Set. Next, for 1 < j < J, 
let us define the collection {Bj ^, 1 < k < Lj} oi Lower sets of X as 



k 

Bj^k = {xeX : AVj{x) > dj^k} = U ^j,, 



1=1 



Now, we express A"Vj ( clS db weighted sum of probabilities of Lower sets in X. 
Lemma 2.4 



n-l 



A-V,{x) = d,,L^ + J2idj,i-dj,i+i)J2piB,,, 1<J<J 



1=1 k=0 



Proof: 



n-l 



yeX k=0 



x,y 

1=1 y^Ajj k=o 
Lj n-l 

1=1 k=0 

Lj-1 n-l 

1=1 k=0 

n—1 Lj — 2 n—1 

dj,L, + {dj,L,-l - rfj,L,) Y.P^B,,,^.r + idj,l - dj,L,-l) Y^pXa,, 

k=0 1=1 k=0 



Continuing this way, finally, we obtain the expression stated in Lemma 2.4 



Lemma 2.5 The sequences |^A"V^(x), n > l}, indexed by the elements x E X, are 
uniformly upper bounded, i.e. for a given 6 > there exists a N{6) such that ^A^Vj{x) < 
c* + 6 for all X e X and n > N{5). m 

Proof: Because the stochastic recursive relation / (equation ([T])) is assumed to be 



order-preserving, the Strassen's Theorem 2.2 implies that for any two states x and y 



such that x ^ y it is true that = x) <g^ (X"|X° = y). In particular, we have 

that = x)eB) > = y) E B) for any Lower set B C X. But this 
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observation in conjunction with Lemma 2.4 allows us to deduce that A"V^ (x) > A"V^ (?/) 
whenever x ^ y. In particular, A'^Vj{y) < A'^Vj{x*) where x* is the minimal element of 
X. Now, for a 5 > 0, we can find N{6) such that ^A"Vj(a;*) < c* + 6. This completes 
the proof. ■ 
Let us fix an arbitrary 6 > 0. From Lemma 2^, it follows that there exits a positive 



integer K such that 



6 for k > K and 1 < j < J. Let us pick one such K, 



and then introduce the set of functions \^g^{x); x E such that the following holds: 



A%{x) = -gfix) + K{c* + 6) (4) 

Two observations on the functions Qj^ are in order: the first and the obvious obser- 
vation is that gf{x) > for a; G A*. Also, since A^Vj{x) < — Ke^ for x G A'^j^<^, we have 
that gf{x) > (c* + 5 + ej) for x E •Aj,K- Set e = miuj ej and S = miuj 5j. As a result, 
we have the obvious deduction that maxj gf{x) > miuj K (c* + 5 + ej) = (c* + 5 + e) for 
X E UjAj^^^. Hence maxj gf{x) < miuj K{c* + 6 + e) implies that x E HjAj^K- We should 
note that x E (IjAj^k need not imply that maxj gf{x) < K (c* + 5 + e). 



2.2 Proof of Theorem 2.1 



Proof: Denote by E^. ((^^(X")) the expectation of (^^(X") 
by Px{X"- E A) the probability that X" E A given that X° = x. 



given that 
Now 



X and 



y&X 1=0 

E^E!'S[-9» + K(c- + ^)] 

^ 1=0 

y£X 1=0 
^ n—1 

-i^E.fe^(X-))+K(c-+i) 



n ^ — ' n 

y&X 1=0 
n-l 

(a) 

n 

y£X 1=0 



=0 



where (a) follows from Q. 

Since lim„^oo ^^^^ = c*, we have that i Er=o' (^?,^ = K5. Now 
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limini -p^ i maxgf(x) < K(c* + 5 + e)] > 1 - limsup - ^ r — -\ 

n^oo n \ j J n^oo n K (c* + (5 + e) 



1=0 j=l ^ ' 

1 

> 1 



1 



K (c* + (5 + e) 

J ^ n-l 



^ limsup i^E4s>>(.Y-)) 
JK5 



i=i ^ z=o 



K (c* + 5 + e) 
(c* + 5 + e) ' 



where (6) follows from Lemma 2.2 



We note that there exists a (5o > such that 1 — , ^ // , ^ > 0. Define the set 

u (c*+<5o+e) 

A = ja; G A" : max g^{x) < K (c* + 5o + e) | 

We can observe that ^ l^j-^j.fc is a finite set. Hence it follows that for the finite set 
A, 



^ n— 1 

lim inf - y (X'^ G A) > 



1=0 



Since the chain is assumed to be irreducible and aperiodic, it follows that the Markov 
chain is positive recurrent. ■ 

Remarks: Rosberg [3] assumed in his model that X = 7/^ for some integer J >2, and 
then considered an equal number J of partitions 1 < j < J, of the countable 

space X, and also the same number J of Lyapunov functions {Vj{x), x G X}, 1 < j < J- 
However, in our generalization of his criterion, we do not require the countable space X 



to have a fixed predetermined dimension. This is reflexed in Assumption |2.1| of Theo- 
rem 



2.1 Hence we are free to choose an appropriate number of Lyapunov functions and 
the corresponding suitable partitions of the state space X. We believe this generalization 
will be useful for the reason that in many situations of interest one does not obtain a state 
space of some fixed predetermined dimension. Moreover, even in the context of a Markov 
chain with some fixed dimension it may not be appropriate to consider an equal number 
J of Lyapunov functions and hence an equal number J of partitions of the state space 
X. Finally, Assumption 2^ of Theorem 2J^ is a refinement of the following definition |2.1 



proposed by Rosberg. But to appreciate this, we need to discuss model considered by 
Rosberg in some more detail. 

Rosberg considered a fixed dimensional non-negative integer space Z'^ and then for 
each dimension j, 1 < j < J, he assumed that there exist positive integers Nj and the 

corresponding partitions | Afj^Ar^. , Af^^J^^ | of the state space X where Xj j^^ = {x E X : 

Xj > Nj} and Xj^n^ = {x E X : Xj < Nj}. Then he assumed that 
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where ej > and rjj > 0. 

He also made another assumption that there exists a positive integer M such that 
Pxy = whenever {xj — Uj) > M for some j, where x,y & X. We can note here that 
Assumption 2^ of Theorem 2A is a generahzation of the assumption made by Rosberg. 

Definition 2.1 (Rosberg [|3j) For 1 < j < J , the sequence |^-^-^, A; > l| is said to 
be uniformly upper bounded (UUB) if, for any 6 > 0, there exists a positive integer K 
such that ^ ^^^^^ < c* + 6 for k >K and x E ^j,Arj+(fc-i)M- 

But now it is straightforward to see that Lemma [23] imphes UUB property of Rosberg. 



Stability Analysis of Slotted- Aloha Protocol with 
Finite Number of Queues 



The rest of this section is organized as follows. In Section 3.1 , we present modeling details 



of the standard slotted- Aloha protocol. In Section 3^, we describe in detail a dominant 
queueing model of the protocol and then present its stability analysis in Section 3.3 In 



Section 3.4, we make some remarks on the instability of the protocol. 



3.1 Model 

Consider a system Si of J transmitting stations. At each station, there is a queue 
with infinite buffer space to store incoming packets and the queue is connected to a 
transmitter. These J transmitters wish to send packets in their respective buffers to a 
common receiver over a collision channel. Transmitter j is assumed to be associated with 
a Bernoulli random process Yj = [YJ^^n > l} where the random variable with the 
distribution p (Yp = l) = pj = 1—p (Yp = O) models the packet transmission attempt of 
the transmitter j in the nth time slot. That is, the jth transmitter with non-empty queue 
transmits in a slot with probability pj and does not transmit with probability pj = 1 — Pj, 
independent of everything else. We denote by Y^ the random vector {Y{^, Y<^, . . . , Yj). 
The communication channel between the transmitters and the receiver is modeled by 
a collision channel model. Under the collision channel model, a packet transmission is 
successful if and only if at most one transmitter with a non-empty queue transmits. 
When more than one transmitter transmits in a slot, all packet transmissions involved in 
that time slot are considered to have collided and hence are lost for all practical purposes. 
The length of a time slot is taken to be the duration of a packet transmission. At the 
end of each time slot, all transmitting stations are provided with ternary feedback which 
tells whether the time slot was idle (no attempted transmissions), successful (exactly one 
transmitter transmitted), or a failure (at least two transmitters transmitted in that time 
slot). 

To model packet arrivals into various queues, we assume that packets arrive randomly 
into various queues and the packet arrival process into queue j is modeled by an i.i.d. 
batch arrival process Aj = |A",n > l} where the random variable A^ with finite first 
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moment E (A") = models the number of packet arrivals into queue j during the nth 
time slot. Define by A the vector (Ai, A2, • . . , Aj) of packet arrival rates. Let denote 
the number of packets present in the queue j at the beginning of the nth time slot. 

72 / 71 71 71 \ 

Denote by Q = [Qi, ■ ■ ■ ^ Qj) the queue-length vector at the beginning of the nth 
time slot. From the assumptions made so far, we can easily note that the queue- length 
process is a discrete-time Markov chain over the countable space Z:^, where 

Z:[ is the set of non-negative integer vectors of dimension J. 

For an event A, let us define the indicator function I{A} as I{A} = 1 if the event A 
is true, and I{A} = otherwise. From the above discussion, it is clear that transmitter 
j transmits a packet if and only if the product l^"! {Qj > O} = 1, and no packet 
transmission happens otherwise. If a packet from the jth queue is involved in collision 
during the nth time slot it is then retransmitted in the (n + l)th time slot with the 
same probability pj. When there is only one transmission in a time slot we say that 
the transmission is successful in that it is received error free at the receiver and the 
corresponding queue length is decremented by 1. The queue length evolution with time 
is given by 

D] = Yp {Q; > 0} n (1 - Y,-l > 0}) 

where the random variable G {0,1} denotes the number of departures from the 
jth queue in the nth time slot. 

3.2 Dominant System 

We now consider another system ^2 of J queues such that when Si and S2 have the 
following identical features Fl, F2, and F3, then S2 will dominate the original system 
Si in the sense that queue lengths in ^2 will be at least as large as the respective queue 
lengths in Si at all times. Let the random variables and denote nthe queue length 
of and the number of departures from the jth queue for the nth time slot. The following 
features are assumed to be identical to both Si and 1S2. 

Fl initial state, i.e., = ■ 

F2 arrival processes, i.e., arrivals into the jth queue in S2 occur exactly at the same 
time instants as in the original system Si. 

F3 transmission attempts, i.e., the Bernoulli random vector that determines trans- 
mission attempts in the original system Si for the nth time slot also determines 
the transmission attempts for the nth time slot in the system 1S2. 

The distinguishing feature of S2 from Si will come from the presence of dummy packet 
transmissions from S2, i.e., queue j of S2 transmits a packet, called dummy packet, with 
probability pj upon becoming empty. The aspect on which the two systems will differ is 
the interference as seen by the individual queues in ^2. By careful construction, we make 
interference for the queue j in ^2 at least as large as the interference seen by the queue 

^ Usage of an over line in the notation will distinguish queue length and departure random variables 
of Si from that of 82- An over line in the notation is used only for the original system Si. 
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j in the original system Si. As a consequence, a successful transmission from the queue 
j in ^2 implies a successful transmission from the queue j of Si provided Qj > 0. But 
the converse need not be true. This fact becomes revealed when we compare the queue 
length evolutions ^ and ([T]), respectively, of Si and S2. Henceforth, we will refer to ^2 
as a dominant of the original Si. 

To be able to define the rules that will specify the interference to be seen by any 
individual queue in ^2, we define two sets Uj and Vj of queues for each queue j. 

Wi = and Uj = {1, 2, . . . , j - 1} for j > 2 
V, = {j + 1 , J + 2, . . . , J} for J < J and Vj = 

The sets Uj and Vj will be designated as, respectively, the set of non-persistent and 
the set of persistent queues of the jth queue for the following reason. A real packet 
transmission from queue j is effected by (i) only real packet transmissions from the queues 
that belong to the set of queues Uj, and (ii) both real and dummy packet transmissions 
from the queues that belong to the set of queues Vj. In other words, each queue j 
in 1S2 transmits a dummy packet with probability pj upon becoming empty. But not 
every real packet transmission is effected by a dummy packet transmission from the jth 
queue. Dummy transmissions are designed only to cause interference but the successful 
transmission of a dummy packet from the queue j has no significance, i.e., queue length 
Qj is unaffected. An interesting point and the main aspect in which our dominant system 
^2 differs from the previous constructions is that different queues have different sets of 
persistent and non-persistent queues in the same time slot. 

From the discussion made above, the queue length evolution in the dominant system 
1S2 can now be represented as 



Q] + A] - 

n(i-n"iM>o}) 



i^"i{g,">o} 



(7) 



For the queue-length vector Q, we define Uj{Q) as the probability that no real packet 
is transmitted from the queues of the set Uj. That is 



ui{Q) = 1 
i-i 

'^AQ) = lli'^-PkHQkX)}) forj>2 

k=l 

Similarly, Vj{Q) will be defined as the probability that neither a real packet trans- 
mission nor a dummy packet transmission will occur from the queues of the set 1/,, 
i.e., 

J 

k=j+i 

vjiQ) = 1 
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We note here that Vj{Q) is queue- length independent and Uj{Q) is queue-length de- 
pendent. Likewise, we define the success probability rj{Q) of the jth queue as 



r,(g) = Uj{Q)pjVj{Q)l{Qi>Q} 

Define the success probability vector r{Q) = r2(Q), . . . ,rj{Q)). For the sake 

of notational convenience, henceforth, we denote the more expressive notation Uj{Q), 
Vj{Q), rj{Q), and r{Q), respectively, as simply Uj, Vj, rj, and r, as long as no ambiguity 
is caused. Some times we may also write Uj{r) in place of Uj{Q) or Uj. From the knowledge 
of r, we can immediately tell which queues are empty and which queues are non-empty 
and hence indices of the non-empty queues in the Uj. Then it becomes straightforward 
to write down the value of Uj{r). Also, in the rest of this paper, we will prefer the more 
convenient notation Qj in place of unless explicit emphasis on the time slot is needed, 
and we extend this rule to other variables too. With the help of the notation introduced 
so far, we now state our central result on stability of the slotted-Aloha protocol. 

Proposition 3.1 Let rj = {rji, 772, ■ • • , Vj) denote a permutation of the set {1, 2, . . . , J}. 
Define C{ri) C ]R:[ to be the set of X that satisfies 



A 



A 



+ I{j>2}J2— < h for 1<J<J 



k=l 



Define C = U^C(?7). Then the dominant system S2 is stable for A G C. ■ 

Since stability of ^2 implies stabihty of Si because of queue length dominance, we 
conclude that the original system Si is also stable for A that satisfies the conditions of 
Proposition 3A In Figure [ij we show a portion of the stability region C when J = 3. 

We will now specialize Proposition 3.1 for J = 2, 3, and J — 00. For J = 2, we have 



C({1,2}) 
C({2,1}) 



A : 



A : 



Ai 


< 1 and 


Ai 






P1P2 




P2 


P2 


A2 


< 1 and 


Ai 








P1P2 




Pi 


Pi 



< 1 



< 1 



Then C = C({1,2}) U C({2, 1}) reduces to the exact stability condition derived by Tsy- 
bakov and Mikhailov [2J. 

Let us now consider J = 3. We have a total of six permutations of the set of queues 
{1,2,3} and the corresponding sufficient conditions for stability are as follows: 



C({1,2,3}) 



A : 



A3 

P3 





Ai 




P1P2P3 


A2 








P2P3 


P2P3 










P3 


P2P3 



< 1 



< 1 



< 1 
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C({1,3,2}) 



C({2,3,1}) 



C({2,1,3}) 



C({3,2,1}) 



C({3,1,2}) 









Ai 




> 












1 
1 














< A : 




A3 


+ 












< 


1 > 






P2P3 


P2P3 








At 


A'^ 


Ai 










+ ^ 






1 






P2 


P2P3 




> 








A2 




> 












1 














< A : 




A3 






1 > 








< 






P3P1 


P1P3 








Ai 


Ad 


Ao 




1 






+ ^ 








Pi 


Pi 


P1P3 




> 








A2 




> 












1 














< A : 




Ai 














< 


1 i. 






P1P3 


P1P3 








^3 


Ai 


Ao 




1 














P3 


P3 


P1P3 




> 








A3 




> 




















P3P1P2 






< A : 




A2 


A3 




1 > 






+ 


< 






P2P1 


P1P2 








A, 
^1 


A,. 


An 




1 








+ 






Pi 


Pi 


P1P2 




> 








A3 




> 












1 








P3P1P2 






\ ■ 




Ai 






















P1P2 


P1P2 








A2 




A3 




1 








+ — 






P2 


P2 


P1P2 




> 



Each of these six sufficient conditions for J = 3 strictly include the respective sufficient 
conditions derived in Rao and Ephremides [3]. For the asymptotic case of J — > 00 and 
symmetric arrival rates and transmission probabilities (i.e., Xj = A and pj = p), our 



result recovers the well known result [12] that the system is unstable. 

3.3 Positive Recurrence of the Queue Length Process {Q", n > 1} 



We now prove Proposition 3.1 for the particular permutation rj = (1,2, ...,J). The 



proof consists of verifying validity of the Assumptions 2A_, 2^, and 2.3| of Theorem 2A_ 



for the Markov chain {Q'^,n > 1}. Then Theorem 2.1 implies the sufficiency condition 



of Proposition 3.1 But to facilitate the presentation, we need to introduce some more 
notation. We say that Q and Q' are "component-wise" partially ordered and write Q ^ Q' 
if Qj < Q'j for 1 < J < J. 
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Figure 1: Figure shows the sufficiency conditions for stabihty for the permutations 
{3,2,1} and {3,1,2}. In the figure, A = (pi,0,0), B = (0,p2,0), C = (0,0,p3), 

O = {piP2P3^PlP2P3,PlP2P3), « = (Plp2,PlP2,0), (3 = (0, P2P3) , 7 = (PlPs , 0, PiPs) , 

P = (Plp2,0,0), Q = (0,piP2,0), X = (P1P3)0,P1P2P3), Y = (0,P2p3,PlP2P3), E = 

{0,PiP2P3,PiP2P3), F = (P1P2P3) 0)Pip2P3)- When A3 = 0, the stabihty region is confined 
to AiA2-plane and the corresponding stabihty region boundary is described by the hne 
segments Aa and Ba. Similarly, the line segments and C7 together represent the 
boundary of the stability region when A2 = 0, and the line segments BP and CP together 
represent the boundary of the stability region when Ai = 0. For A3 < P1P2P3, the plane 
segment AaOX, bearing the plane equation ^ + ^ + =^ = 1 and the plane segment 

QaOE, bearing the plane equation =^ + =^ = 1, together describe the sufficiency 
condition for stability. 
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We note that the distribution of the departure random variable Dj is p{Dj = 1) = 
r j = 1 — p{Dj = 0). Hence follows that 



E(D,) = r, (8) 

Define 71 to be the set of all success probability vectors, i.e. 71 = {r{Q) : Q G Z:[}. 
For 1 < j < J, we define a partition {TZj, 7Z^} of the set 7Z as 



7Zj = {r e7Z: rj = 0} and = {r G 7^ : > 0} 

Define the mapping g ■.Z-l^7Zhj g{Q) = (ri(Q), r2(Q), • • . ,rj(Q)), 
where g{Q) is the vector of success probabilities when the queue length vector is 
Q. Since the knowledge of which queues are empty and which queues are non-empty 
alone is sufficient to determine the success probability vector r, we can group all queue 
length vectors Q that result in the same r. This is done by defining the set-valued map 
g~^ : 7?. — s> Z:[ as 



g-\r) 4 {Q E Zi : g{Q) = r} 

We note that the collection {g~^{r),r G 7Z} of sets defines a partition of the space 
queue length vectors, Z"^. 

Next, we prove that there exist positive weights such that the sum of weighted expected 
number of departures from the queues that belong to the set {1, 2, . . . , j} conditioned on 
the event {Qj > 1} equals one, and when conditioned on the event {Qj = 0}, equals the 
probability {1 — uj) that there is at least one transmission from the set of queues Uj. We 
establish this fact for every j. For brevity, let us define the random variable 



Lemma 3.1 

j 1-uj tfA = {Q,=0} 
\1 ifA = {Q,>l} 

m 

Proof: Suppose that for some ki and ^2 such that l<ki<k2<j<J, let it be 
true that (i) Qk^ > and Qk2 > 0, and (ii) every other queue I, ki < I < k2, is such that 
Qi = 0. Then it is easy to note that = Pki'^k^- As a consequence, we can immediately 
note that + Pki^ki = Uki- Then 



e(d, 



i-i 

E (d,- I Qj > l) u, + l{j > 2} ^ pkUkl {Qk > 0} 1 

k=l 



where (a) follows from (|8]) and (6) follows by repeatedly applying the observation 
made above. Almost on the similar lines, we can also note that 
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J-1 



k=l 



Now, we are at a stage to verify the Assumption 2.1 To verify the Assumption 2.1 
consider the Lyapunov functions Vj, 1 < j < J, defined as 



VAQ) = ^ + i{j>2}X:^ 

Over the state space {Qj > 1}, the drift AVj{Q) can be written as 



(9) 



Qj>i 



= ^+i{j>2}x:^-i 

Likewise, the drift AVj{Q) over the state space {Qj = 0} can be written as 



(10) 



AV.iQ) 



+ I{j>2}5^^-(l-«,) 



k=l 



Vk 



where (10) and (11) follow from Lemma 3.1 



2.2 



Define AU = {Q e : Qj > k} and Aj^k = {Q e 



We now verify Assumption 
Z+ : Qj < k}. We can easily see that Dj^iAj^k is a finite set. 

We can now make an important observation that with respect to the component-wise 
partial order the drift AVj{Q) is a non-increasing function of the argument Q. To see this. 



we note that E (Dj) is at most one and this value is attained when Qj > 1 irrespective of 



the size of other queues. When Qj = 0, E yDjj equals the probability 1 — Uj that there 

is at least one transmission from the set Uj of queues. But for two states Q and Q' such 
that Qj = Q'j = and Q < Q', the set of non-empty queues associated with the queue 
length vector Q is a subset of the set of non-empty queues associated with the queue 
length vector Q'. Hence the the probability that there is at least one transmission from 
the set Uj of queues associated with the state Q' is at least as large as the corresponding 

probability associated with the state Q. In other words, for 1 < j < J, E (^Dj^ is a 

non-decreasing function of the state Q, and hence the drift AVj{Q) is a non-increasing 
function of the argument Q. These arguments essentially verify the second part the 



Assumption 2.3 



We now prove that the stochastic recursive relation ^ that models the queue lengths 
evolution of the dominant system ^2 is order preserving. Consider two queue length 
vectors Q and Q' such that Q < Q' . Then let us imagine two dominant systems of which 
the first one is started in state Q and the second one is started in state Q' but both are 
fed by the identical input processes {F", n>l} and {A", n > 1}. An obvious inference is 
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that the set of non-empty queues of lAj{Q) is contained in the set of non-empty queues of 
Uj{Q'). Hence a successful transmission from queue j corresponding to the state Q need 
not imply a successful transmission from queue j of the state Q' . In other words, the 
queue lengths in the dominant system corresponding to the initial state Q' dominate the 
corresponding queue lengths in the dominant system corresponding to the initial state 
Q, and hence the queue length evolution ([T]) is order preserving. 

3.4 Remarks on the Sufficient Conditions for instability of Si 

We use the indistinguishability argument of [5] and [1] to derive sufficient conditions for 
transience of the Markov chain. We shall use a coupling argument to show that with 
positive probability the dominant system S2 and the original system Si are indistinguish- 



able under the stated sufficient condition for transience of ^2 in Proposition |3.2[ Hence 
instability of the dominant system ^2 also implies instability of the original system Si. 
But before we proceed further in this section, we state a sufficient condition for transience 
in the context of Markov chains over a countable state space. 

Theorem 3.1 (Theorem 8.0.2 (i) of | il3j ) An irreducible Markov chain over a count- 
able space X is transient iff there exists a bounded non-negative function, V , and a 
non-empty set C d X such that for all x G C^, AV{x) > 0, and 3x G such that 
V{x) > snpy^c^iy)- 

Proposition 3.2 Let rj = (771,772, • • • ,t]j) denote a permutation of the set {1,2, . . . , J}. 
Define Virf) C Mi to be the set of A that satisfies 



Pvi ^'71 
Ar,, ^ A 



< 1 



+ E— > 1' /'^^ 2<j< J 

Pvj^rij k^i ^Vk 

Define V = [JrfD{ri). Then the dominant system S2 is unstable for A G "D. ■ 

Proof: Let < < 1. For each j, 2 < j < J, consider the Lyapunov function 
Zj{Q,6) = 1 — 6^3^^\ where Vj{Q) is as defined in equation First, we note that the 
Lyapunov function Zj{Q,9) is bounded. Define the drift AZj{Q,9) as 

Differentiating AZj{Q,6) with respect to 6, we obtain 
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The following two observations are immediate: (i) AZj(Q, 1) = and (ii) '^^^^g'^'^"' 



So'ez-' i^jiQ) ~ ^jiQ')) PqQ' = ~^^jiQ) where AVj{Q) is as defined in equations (10) 



and (11). 



Let us now suppose that AVj{Q) > over the entire state space Z:[. Because 
AZj{Q, 9) is a differentiable function of 6 and also because of the observation (i) and (ii) 
made above, there exists a < < 1 such that AZj{Q, 9*) > over the state space Z-;^. 



Hence the sufficiency condition stated in Theorem 3.1 for transience of the Markov chain 



{Q^, > 1} is satisfied. Finally, we note that — h X]i=i ^ > ^ ^ j ^ J imply 

AVjiQ) > for 2 < j < J. ' ' ' h 

Remarks: 

1. The indistinguishability argument is based on the fact that the dominant and the 
original are identical as long as the their queues do not empty. 

2. If our aim is to derive sufficient conditions for instability of the dominant system ^2, 
then the conditions stated in the Proposition |3.2 are too strong. The requirement 



that ^ + I{j > 2} J2{J^ ^ > 1 for at least one j, 1 < j < J, is sufficient for 
instability of But we require the conditions under which the dominant system 
^2 is indistinguishable from the original system Si and hence the need for the 
requirement that ^ + I{j > 2} Y^iZl ^ > 1 for 2 < j < J. 

4 Conclusion 

In this paper, we have revisited the stability analysis of slotted-Aloha protocol with 



finite number of queues by applying Theorem 2.1 which is a generalization of the positive 
recurrence criterion due to Rosberg [3]. An aim in this paper has been to illustrate 
how stochastic monotonicity arguments in conjunction with Lyapunov-drift properties 
can be used in establishing positive recurrence of a Markov chain in a countable space 



setting. We have seen that two steps are involved in verifying Theorem 2.1 The first 



step involves verifying Assumptions 2.1 and 2.2 The second step is about verifying 
Assumption |2.3 and is also the stage where we invoke stochastic monotonicity arguments 
of the underlying Markov chain. Our experience so far has been that one of these two 
steps is hard to verify, if not both, depending on the problem. A simplifying feature of 
this positive recurrence criterion we believe is that it allows one to think of Lyapunov- 
drift properties confined to certain proper subsets of the state space, which is relatively 
simpler, rather than the entire state space, which is harder. An interesting topic for 
further research on this problem would be to provide tighter sufficiency conditions for 
transience of the protocol. 
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